Partial Adaptation of Obtained and Observed Value Signals Preserves Information about Gains and Losses

Given that the range of rewarding and punishing outcomes of actions is large but neural coding capacity is limited, efficient processing of outcomes by the brain is necessary. One mechanism to increase efficiency is to rescale neural output to the range of outcomes expected in the current context, and process only experienced deviations from this expectation. However, this mechanism comes at the cost of not being able to discriminate between unexpectedly low losses when times are bad versus unexpectedly high gains when times are good. Thus, too much adaptation would result in disregarding information about the nature and absolute magnitude of outcomes, preventing learning about the longer-term value structure of the environment. Here we investigate the degree of adaptation in outcome coding brain regions in humans, for directly experienced outcomes and observed outcomes. We scanned participants while they performed a social learning task in gain and loss blocks. Multivariate pattern analysis showed two distinct networks of brain regions adapt to the most likely outcomes within a block. Frontostriatal areas adapted to directly experienced outcomes, whereas lateral frontal and temporoparietal regions adapted to observed social outcomes. Critically, in both cases, adaptation was incomplete and information about whether the outcomes arose in a gain block or a loss block was retained. Univariate analysis confirmed incomplete adaptive coding in these regions but also detected nonadapting outcome signals. Thus, although neural areas rescale their responses to outcomes for efficient coding, they adapt incompletely and keep track of the longer-term incentives available in the environment

Partial Adaptation of Obtained and Observed Value Signals Preserves Information about Gains and Losses.

UNLABELLED: Given that the range of rewarding and punishing outcomes of actions is large but neural coding capacity is limited, efficient processing of outcomes by the brain is necessary. One mechanism to increase efficiency is to rescale neural output to the range of outcomes expected in the current context, and process only experienced deviations from this expectation. However, this mechanism comes at the cost of not being able to discriminate between unexpectedly low losses when times are bad versus unexpectedly high gains when times are good. Thus, too much adaptation would result in disregarding information about the nature and absolute magnitude of outcomes, preventing learning about the longer-term value structure of the environment. Here we investigate the degree of adaptation in outcome coding brain regions in humans, for directly experienced outcomes and observed outcomes. We scanned participants while they performed a social learning task in gain and loss blocks. Multivariate pattern analysis showed two distinct networks of brain regions adapt to the most likely outcomes within a block. Frontostriatal areas adapted to directly experienced outcomes, whereas lateral frontal and temporoparietal regions adapted to observed social outcomes. Critically, in both cases, adaptation was incomplete and information about whether the outcomes arose in a gain block or a loss block was retained. Univariate analysis confirmed incomplete adaptive coding in these regions but also detected nonadapting outcome signals. Thus, although neural areas rescale their responses to outcomes for efficient coding, they adapt incompletely and keep track of the longer-term incentives available in the environment. SIGNIFICANCE STATEMENT: Optimal value-based choice requires that the brain precisely and efficiently represents positive and negative outcomes. One way to increase efficiency is to adapt responding to the most likely outcomes in a given context. However, too strong adaptation would result in loss of precise representation (e.g., when the avoidance of a loss in a loss-context is coded the same as receipt of a gain in a gain-context). We investigated an intermediate form of adaptation that is efficient while maintaining information about received gains and avoided losses. We found that frontostriatal areas adapted to directly experienced outcomes, whereas lateral frontal and temporoparietal regions adapted to observed social outcomes. Importantly, adaptation was intermediate, in line with influential models of reference dependence in behavioral economics

Computing Inferences for Large-Scale Continuous-Time Markov Chains by Combining Lumping with Imprecision

If the state space of a homogeneous continuous-time Markov chain is too large, making inferences - here limited to determining marginal or limit expectations - becomes computationally infeasible. Fortunately, the state space of such a chain is usually too detailed for the inferences we are interested in, in the sense that a less detailed - smaller - state space suffices to unambiguously formalise the inference. However, in general this so-called lumped state space inhibits computing exact inferences because the corresponding dynamics are unknown and/or intractable to obtain. We address this issue by considering an imprecise continuous-time Markov chain. In this way, we are able to provide guaranteed lower and upper bounds for the inferences of interest, without suffering from the curse of dimensionality.Comment: 9th International Conference on Soft Methods in Probability and Statistics (SMPS 2018

Cervicovaginal microbiota and women's health outcomes

The human cervicovaginal microbiome has an important role in the health and homoeostasis of the female reproductive tract. A eubiotic microbiome is typically dominated with lactic acid producing bacteria and is categorised into five community state types. Issues arise when the microbiome becomes dysbiotic, with the microbial composition shifting to contain a greater relative abundance of strict and facultative anaerobes. This shift will lead to several adverse changes in the vaginal environment including compromised epithelial cells, cell death, inflammation, and greater susceptibility to infection. These changes are associated with various adverse outcomes including infections, preterm birth, and infertility. In this review, we discuss how the cervicovaginal microbiome influences these outcomes and possible future directions of treatment and research

Exoplanet Catalogues

One of the most exciting developments in the field of exoplanets has been the progression from 'stamp-collecting' to demography, from discovery to characterisation, from exoplanets to comparative exoplanetology. There is an exhilaration when a prediction is confirmed, a trend is observed, or a new population appears. This transition has been driven by the rise in the sheer number of known exoplanets, which has been rising exponentially for two decades (Mamajek 2016). However, the careful collection, scrutiny and organisation of these exoplanets is necessary for drawing robust, scientific conclusions that are sensitive to the biases and caveats that have gone into their discovery. The purpose of this chapter is to discuss and demonstrate important considerations to keep in mind when examining or constructing a catalogue of exoplanets. First, we introduce the value of exoplanetary catalogues. There are a handful of large, online databases that aggregate the available exoplanet literature and render it digestible and navigable - an ever more complex task with the growing number and diversity of exoplanet discoveries. We compare and contrast three of the most up-to-date general catalogues, including the data and tools that are available. We then describe exoplanet catalogues that were constructed to address specific science questions or exoplanet discovery space. Although we do not attempt to list or summarise all the published lists of exoplanets in the literature in this chapter, we explore the case study of the NASA Kepler mission planet catalogues in some detail. Finally, we lay out some of the best practices to adopt when constructing or utilising an exoplanet catalogue.Comment: 14 pages, 6 figures. Invited review chapter, to appear in "Handbook of Exoplanets", edited by H.J. Deeg and J.A. Belmonte, section editor N. Batalh

Computing inferences for large-scale continuous-time Markov chains by combining lumping with imprecision

If the state space of a homogeneous continuous-time Markov chain is too large, making inferences—here limited to determining marginal or limit expectations—becomes computationally infeasible. Fortunately, the state space of such a chain is usually too detailed for the inferences we are interested in, in the sense that a less detailed—smaller—state space suffices to unambiguously formalise the inference. However, in general this so-called lumped state space inhibits computing exact inferences because the corresponding dynamics are unknown and/or intractable to obtain. We address this issue by considering an imprecise continuous-time Markov chain. In this way, we are able to provide guaranteed lower and upper bounds for the inferences of interest, without suffering from the curse of dimensionality

Plasma and rectal mucosal oxylipin levels during aspirin and eicosapentaenoic acid treatment in the seAFOod polyp prevention trial

BACKGROUND: Aspirin and eicosapentaenoic acid (EPA) have colorectal polyp prevention activity, alone and in combination. This study measured levels of plasma and rectal mucosal oxylipins in participants of the seAFOod 2 × 2 factorial, randomised, placebo-controlled trial, who received aspirin 300 mg daily and EPA 2000 mg free fatty acid, alone and in combination, for 12 months. METHODS: Resolvin (Rv) E1, 15-epi-lipoxin (LX) A4 and respective precursors 18-HEPE and 15-HETE (with chiral separation) were measured by ultra-high performance liquid chromatography-tandem mass spectrometry in plasma taken at baseline, 6 months and 12 months, as well as rectal mucosa obtained at trial exit colonoscopy at 12 months, in 401 trial participants. RESULTS: Despite detection of S- and R- enantiomers of 18-HEPE and 15-HETE in ng/ml concentrations, RvE1 or 15‑epi-LXA4 were not detected above a limit of detection of 20 pg/ml in plasma or rectal mucosa, even in individuals randomised to both aspirin and EPA. We have confirmed in a large clinical trial cohort that prolonged (12 months) treatment with EPA is associated with increased plasma 18-HEPE concentrations (median [inter-quartile range] total 18-HEPE 0.51 [0.21-1.95] ng/ml at baseline versus 0.95 [0.46-4.06] ng/ml at 6 months [P<0.0001] in those randomised to EPA alone), which correlate strongly with respective rectal mucosal 18-HEPE levels (r = 0.82; P<0.001), but which do not predict polyp prevention efficacy by EPA or aspirin. CONCLUSION: Analysis of seAFOod trial plasma and rectal mucosal samples has not provided evidence of synthesis of the EPA-derived specialised pro-resolving mediator RvE1 or aspirin-trigged lipoxin 15‑epi-LXA4. We cannot rule out degradation of individual oxylipins during sample collection and storage but readily measurable precursor oxylipins argues against widespread degradation

A Universal Model of Global Civil Unrest

Civil unrest is a powerful form of collective human dynamics, which has led to major transitions of societies in modern history. The study of collective human dynamics, including collective aggression, has been the focus of much discussion in the context of modeling and identification of universal patterns of behavior. In contrast, the possibility that civil unrest activities, across countries and over long time periods, are governed by universal mechanisms has not been explored. Here, we analyze records of civil unrest of 170 countries during the period 1919-2008. We demonstrate that the distributions of the number of unrest events per year are robustly reproduced by a nonlinear, spatially extended dynamical model, which reflects the spread of civil disorder between geographic regions connected through social and communication networks. The results also expose the similarity between global social instability and the dynamics of natural hazards and epidemics.Comment: 8 pages, 3 figure

Elevated arousal at time of decision-making is not the arbiter of risk avoidance in chickens

The somatic marker hypothesis proposes that humans recall previously experienced physiological responses to aid decision-making under uncertainty. However, little is known about the mechanisms used by non-human animals to integrate risk perception with predicted gains and losses. We monitored the behaviour and physiology of chickens when the choice between a high-gain (large food quantity), high-risk (1 in 4 probability of receiving an air-puff) option (HGRAP) or a low-gain (small food quantity), no-risk (of an air-puff) (LGNAP) option. We assessed when arousal increased by considering different stages of the decision-making process (baseline, viewing, anticipation, reward periods) and investigated whether autonomic responses influenced choice outcome both immediately and in the subsequent trial. Chickens were faster to choose and their heart-rate significantly increased between the viewing and anticipation (post-decision, pre-outcome) periods when selecting the HGRAP option. This suggests that they responded physiologically to the impending risk. Additionally, arousal was greater following a HGRAP choice that resulted in an air-puff, but this did not deter chickens from subsequently choosing HGRAP. In contrast to human studies, we did not find evidence that somatic markers were activated during the viewing period, suggesting that arousal is not a good measure of avoidance in non-human animals